IN THE CLAIMS: 

Please cancel claims 16-22 and 50. 

1 . (Original) A method for ensuring robustness of a natural language understanding 
(NLU) system comprising the steps of: 

tagging recognized words of a command input to the NLU system to associate the 
command with a context; 

translating the command to at least one formal command based on the tagged words; 

determining a top ranked formal command based on scoring of the tagged recognized 
words and scoring translations of the at least one formal command; 

determining whether the top ranked formal command is accepted by comparing a feature 
vector of the top ranked formal command to representations of feature vectors stored in an accept 
model; and 

executing the top ranked formal command if accepted and preventing incorrect commands 
from execution to provide a robust NLU system. 

2. (Original) The method as recited in claim 1 , wherein the step of determining a top 
ranked formal command includes the step of ranking formal commands based on a product of 
scores of the tagged words and scores of translations of the at least one formal command. 



3. (Original) The method as recited in claim 1, wherein the step of determining a top 
ranked formal command includes the step of ranking N formal commands where N is a selectable 
system parameter. 

4. (Original) The method as recited in claim 1 , further comprising the step of 
determining whether the top ranked formal command is rejected by comparing the feature vector 
of the top ranked formal command to representations of feature vectors stored in a reject model. 

5. (Original) The method as recited in claim 4, further comprising the step of 
providing the reject model by including representations of feature vectors of formal commands 
corresponding to words or sentences to be rejected. 

6. (Original) The method as recited in claim 4, wherein the reject model includes a 
cluster of models. 

7. (Original) The method as recited in claim 6, further comprising the step of 
clustering the cluster of models based on at least one of mistakes in commands, mistakes in 
arguments of the command, and processing mistakes. 
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8. (Original) The method as recited in claim 1, further comprising the step of 
providing the accept model by including representations of feature vectors of formal commands 
corresponding to words or sentences to be accepted. 

9. (Original) The method as recited in claim 1 , wherein the step of determining 
whether the top ranked formal command is accepted includes the step of computing a probability 
of acceptance for the command. 

10. (Original) The method as recited in claim 9, wherein the step of computing a 
probability of acceptance for the command includes the steps of: 

computing a probability of rejection for the command and comparing the probability of 
acceptance to the probability of rejection to determine if the command is to be executed. 

1 1 . (Original) The method as recited in claim 9, wherein the step of computing a 
probability of acceptance for the command includes the step of comparing the probability of 
acceptance to a threshold probability to determine if the command is to be executed. 

12. (Original) The method as recited in claim 1 1 , further comprising the step of 
modifying the threshold by the user. 



13. (Original) The method as recited in claim 1, wherein the accept model includes a 
cluster of models. 



14. (Original) The method as recited in claim 13, fiirther comprising the step of 
clustering the cluster of models based on at least one of mistakes in commands, mistakes in 
arguments of the command, and processing mistakes. 

1 5 . (Original) The method as recited in claim 1 , wherein the step of preventing 
incorrect commands, includes executing a do nothing command responsive to the incorrect 
commands. 

16. (Canceled) 

17. (Canceled) 

18. (Canceled) 

19. (Canceled) 

20. (Canceled) 
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21. (Canceled) 



22. (Canceled) 

23. (Original) A program storage device readable by machine, tangibly embodying a 
program of instructions executable by the machine to perform method steps for ensuring 
robustness of a natural language understanding (NLU) system, the method steps comprising: 

tagging recognized words of a command input to the NLU system to associate the 
command with a context; 

translating the command to at least one formal command based on the tagged words; 

determining a top ranked formal command based on scoring of the tagged recognized 
words and scoring translations of the at least one formal command; 

determining whether the top ranked formal command is accepted by comparing a feature 
vector of the top ranked formal command to representations of feature vectors stored in an accept 
model; and 

executing the top ranked formal command if accepted and preventing incorrect commands 
from execution to provide a robust NLU system. 

24. (Original) The program storage device as recited in claim 23, wherein the step of 
determining a top ranked formal command includes the step of ranking formal commands based 
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on a product of scores of the tagged words and scores of translations of the at least one formal 
command. 

25. (Original) The program storage device as recited in claim 23, wherein the step of 
determining a top ranked formal command includes the step of ranking N formal commands 
where N is a selectable system parameter. 

26. (Original) The program storage device as recited in claim 23, further comprising 
the step of determining whether the top ranked formal command is rejected by comparing the 
feature vector of the top ranked formal command to representations of feature vectors stored in a 
reject model. 

27. (Original) The program storage device as recited in claim 26, further comprising 
the step of providing the reject model by including representations of feature vectors of formal 
commands corresponding to words or sentences to be rejected. 

28. (Original) The program storage device as recited in claim 26, wherein the reject 
model includes a cluster of models. 



-7- 



29. (Original) The program storage device as recited in claim 28, further comprising 
the step of clustering the cluster of models based on at least one of mistakes in commands, 
mistakes in arguments of the command, and processing mistakes. 

30. (Original) The program storage device as recited in claim 23, further comprising 
the step of providing the accept model by including representations of feature vectors of formal 
commands corresponding to words or sentences to be accepted. 

3 1 . (Original) The program storage device as recited in claim 23, wherein the step of 
determining whether the top ranked formal command is accepted includes the step of computing a 
probability of acceptance for the command. 

32. (Original) The program storage device as recited in claim 31, wherein the step of 
computing a probability of acceptance for the command includes the steps of: 

computing a probability of rejection for the command and comparing the probability of 
acceptance to the probability of rejection to determine if the command is to be executed. ^ 

33. (Original) The program storage device as recited in claim 31, wherein the step of 
computing a probability of acceptance for the command includes the step of comparing the 
probability of acceptance to a threshold probability to determine if the command is to be executed. 
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34. (Original) The program storage device as recited in claim 33, further comprising 
the step of modifying the threshold by the user. 

35. (Original) The program storage device as recited in claim 23, wherein the accept 
model includes a cluster of models. 

36. (Original) The program storage device as recited in claim 35, further comprising 
the step of clustering the cluster of models based on at least one of mistakes in commands, 
mistakes in arguments of the command, and processing mistakes. 

37. (Original) The program storage device as recited in claim 23, wherein the step of 
preventing incorrect commands, includes executing a do nothing command responsive to the 
incorrect commands. 

38. (Original) A natural language understanding (NLU) system comprising: 
means for tagging recognized words of a command input to the NLU system to associate 

the command with a context; 

means for translating the command to at least one formal command based on the tagged 

words; 



a robustness checker for determining a top ranked formal command based on scoring of 
the tagged recognized words and scoring translations the at least one formal command, the 
robustness checker for determining whether the top ranked formal command is accepted by 
comparing a feature vector of the top ranked formal command to representations feature vectors 
stored in an accept model; and 

a command executor for executing the top ranked formal command if accepted and 
preventing incorrect commands from execution to provide a robust NLU system. 

39. (Original) The system as recited in claim 38, wherein the top ranked formal 
command is ranked based on a product of scores of the tagged words and scores of translations of 
the at least one formal command. 

40. (Original) The system as recited in claim 38, wherein the top ranked formal 
command is selected from a ranked list of N formal commands where N is a selectable system 
parameter. 

41 . (Original) The system as recited in claim 38, further comprising an accept model 
for storing representations feature vectors of accept commands, the representations of feature 
vectors being employed to compare with a user input command to determine an acceptance 
probability of formal commands. 
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42. (Original) The method as recited in claim 41, wherein the accept model includes a 
cluster of models. 

43. (Original) The system as recited in claim 38, further comprising a reject model for 
storing representations of feature vectors of reject commands, the feature vectors being employed 
to compare with a user input command to determine a rejection probability of formal commands. 

44. (Original) The system as recited in claim 43, wherein the reject model includes a 
cluster of models. 

45. (Original) The system as recited in claim 38, wherein the robustness checker 
includes a feature extractor for extracting feature vectors from the command. 

46. (Original) The system as recited in claim 38, wherein the feature vectors include 
tagging scores for recognized words of a word or sentence represented by the feature vector and 
translation scores for formal commands associated with the word or sentence represented by the 
feature vector. 

47. (Original) The system as recited in claim 38, wherein the feature vectors include a 
do nothing score associated with words and sentences, the do nothing score for indicating a 
probability that a do nothing command is present for associated words and sentences, the do 
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nothing command being associated with incomplete or incorrect commands which may be input as 
a command. 

48. (Original) The system as recited in claim 38, wherein the feature vectors include at 
least one of a top command similarity measure for counting identical formal commands and a 
parameter mismatch feature for measuring a number of command arguments in a translation of a 
command. 

49. (Original) The system as recited in claim 38, wherein the robustness checker 
includes a robustness evaluator for determining whether the top ranked formal command is 
accepted by comparing the top ranked formal command to feature vectors stored in an accept 
model. 

50. (Canceled) 
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